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ABSTRACT 

We consider network optimization problems in which the weights of the edges are random variables. We 
develop conditions on the combinatorial structure of the problem which guarantee that the objective function value is 
a first passage time in an appropriately constructed Markov process. The arc weights must be exponentially 
distributed, the method of solution of the deterministic problem must be greedy in a general sense, and the 
accumulation of objective function value during the greedy procedure must occur at a constant rate. We call these 
structures constant access systems after the third property. Examples of constant access systems include the shortest 
path system, the longest path system, time until disconnection in a network of failing components, and some 
bottleneck optimization problems. For each system, we give the distribution of the objective function, the 
distribution of the solution of the problem, and the probability that a given arc is a member of the optimal solution. 
We also provide easily implementable formulae for the moments of these quantities. 



1.0 INTRODUCTION 



In this paper, we unify a set of results concerning the performance of networks w'ith random arc weights. 
Finding the distributions of the shortest path, longest path, and maximum flow were provided in Kulkarni[1987], 
Kuikami and Adlakha[1986], and Kulkami [1987], where each problem was considered on a network with 
independent, exponentially distributed arc weights. In each case, a Markov process was constructed for which the 
first passage time to a set of states was the optimal objective function value of the problem. Thus, the distribution, 
moments, etc., of the optimal objective function value could be found using standard Markov process technique. 

The same methodology was applied to the nonplanar maximum flow problem and to Prim’s spanning tree 
problem, neither attempt being successful. We could not construct a Markov process with first passage time equal 
to the objective function value for either problem, though these problems seem closely related to the problems for 
which the method was successful. This left the investigators with the problem of determining which characteristics 
of these optimization problems was essential in order to ensure that a Markov process solution exists. 

This paper provides a general framework for randomly weighted network optimization problems which have 
optimal objective function values are given by absorption times of some Markov process. The restrictions which 
describe this class are that the method of solution is essentially greedy, and that the underlying combinatorial 
structure have two properties which we call the constant access and interval properties. For any combinatorial 
optimization problem with these properties, we give the construction of the Markov process required. For each 
system, we give the distribution of the objective function, the distribution of the solution of the problem, and the 
probability that a given arc is a member of the optimal solution. We also provide easily implementable formulae 
for the moments of these quantities. All of these calculations exploit the uppertriangularity of the generator matrix 
pf the constructed Markov process. 

Awareness of a general class of constant access systems allows us to consider other combinatorial optimization 
problems and to determine if they may be extended to the randomly weighted case using Markov processes. By 
pinpointing the required properties for successful application of Markov processes to the objective function 
jiistribution problem, w'e can narrow the search for problems for which we expect success. Stated differently, we 
jiave shown that the mechanism of transition in Markov processes is identical to the mechanism of access of the 
greedy algorithm. 
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Let E be a set of elements, typically the edges of a graph, and let B be a set of strings made up of elements in 
E. For each Ye B, let W(Y) be a random variable corresponding to the objective function value of Y. We are 
interested in computing 



F(Y, t) = P[W(Y) < t, W(Y) < W(Y') for all Y' e B], 

the probability that Y is the minimum weight element of B and its value does not exceed t. The marginals of F 
may be used to Find the distribution of the optimal objective function value, criticality indices for each arc, and other 
interesting network performance measures. In Dijkstra’s shortest path algorithm (forward looking version), B is the 
set of states which have the destination permanently labeled. If Y is one such state, F(Y, t) is the probability that Y 
is the terminating state of the algorithm and the shortest path has length not exceeding t. If we aggregate all of the 
states which give the same shortest path, we can sum the probabilities to find the probability that a given path is 
shortest and its length does not exceed t, and we can let t -» « to Find the probability that a given path is shortest. 

In this work, we will identify a class of problems for which a stochastic process {X(t),t>0) may be 
constructed such that each Y e B is an absorbing state of {X(t),t>0}. The fundamental property of (X(t)} is 
that F(Y, t) is the distribution of the time of [X(t)}’s first passage to Y. Characteristics of this class of 
combinatorial problems include optimality of the greedy algorithm for the underlying deterministic combinatorial 
problem, as well as two properties called the interval and constant access properties. The stochastic process 
[X(t), t > 0} is shown to be a generalized semi-Markov process (GSMP). When the arc weights are exponentially 
distributed and independent, (X(t), t > 0} is a Markov process. 

In Section 2 we outline the combinatorial structures which we will treat. Section 3 contains the combinatorial 
results required to pursue the case of random weights. Section 4 contains the analysis of stochastic combinatorial 
problems, including the conditions under which the stochastic system is a Markov process. We use the Markov 
process to derive distributions of interest and we include some results on computational efficiency. In Section 5 we 
detail some important examples of constant access systems. While some of these systems have been investigated ad 
hoc in [1987], [1986], and [1987], several of these systems are new to the literature. They were uncovered as 
constant access systems as a result of the construction of the general system. Section 6 contains our conclusions 
and some comments concerning extensions of this work. 
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2.0 BASIC COMBINATORICS 



In this section, we establish the terminology and notation necessary to describe the systems we study. We 
define the minimizing greedy algorithm and give Dijkstra's shortest path system as an example. 

Let E be a set which we refer to as the ground set, and let £ be a set of simple strings (ordered sets with no 
repeats) of elements in E. Let X g then the i-th element in the string X is denoted xi, and the length of the 
string is given by | X | . We will denote the operation of concatenation as Thus if X = (x p x 2 , ..., x k ), 

ct g E, and Y = (y r y 2 , y m ), then Xa = (x r x 2 , ..., x k , a), and X Y = (x p x 2 ,..., x k , y p y 2 y m ). 

For the string X = (x r x 2 ,...,x k ), the string made up of the first i elements, i < k, will be denoted X j( 
X { = (x r x 2 ,... .xj), and is called a prefix of X. We will use set operations n, u, C , and g on the strings of £ to 

indicate the operation performed on the underlying set of the string. 

In this work, we will deal with string systems have the following properties: 

i) <t> e C: 

ii) X e C implies that Y e C for all Y C X. 

The set £ is called the set of feasible strings. 

We often wish to refer to the set of elements of E which we can feasibly append to the string X e denoted as 
A(X). This set is called the set of accessible elements of X and is formally given by A(X) = 
{x g E: Xx g £}. When an element of A(X) is appended to X, it is said to have been accessed. The set B is 
defined as B = {X g A(X) = 0), and is called the set of basic strings, following the terminology' used in matroid 
theory. An access chain to X g £, | X | = k, is the sequence of feasible strings X 0 = <J), X v X^, ..., X k = X. Note 
that for any X g | X | = k, (Yg B;_X is on a chain of access to Y) = {Yg B: Y k = X k ). 

2.1 Clutter Intersection Systems 

Let v:E 9^ + be a nonnegative weight function on the set E. For each Yg B, define d*(Y) to be a known 
subset of { Y } called the determining structure of Y. Let w be the objective function on B given by 

w 00 = £, S dV) V M’ 

thus, each basic element's weight is linear in its determining structure. Note that if d *(Y) equals the underlying set 
of Y, then w is the linear objective function common to matroid analysis. 

In our development, we will make the following two assumptions concerning determining structures of basic 
elements: 
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i) U Y6B d*(Y) = E 

ii) d*(Y) £ d*(Z) for any Y, Z e B, Y * Z. 

Thus the set (d*(Y): Y e B) is a clutter on the set E, see Edmonds and Fulkerson [1970]. Assumption i 
guarantees that every member of E belongs to at least one determining structure. Assumption ii guarantees that for 
each determining structure of a basic element, there exists a weight function for which that determining structure is 
of minimum weight. In a two terminal undirected network in which each arc is on a path between the terminals, the 
set of paths is a clutter on the set of arcs in a connected network, as is the set of (minimal) cutsets. 

The set {d*(Y): Y e B) fully describes the objective function w for basic strings of £, however w (X) for X e C, 
- B is still left undetermined. We extend the notion of determining structures to nonbasic strings. Let X be a 
nonbasic element of Define T(X) as T(X) = {d*(Y): X C Y, Y e B). Thus, T(X) is the set of determining 

structures of basic strings which can terminate any chain of access containing X. Let 

w(X) = max d * C0€nX) 1/^ v(x) (2.1) 

and let d*(X) = d*(Y) n X for the maximizing Y e T(X). Note that d*(X) implicitly depends on the weight function 
v. The triple (E, £, d*) will denote a system with ground set E, feasible strings z, and determining structure function 
d*. 

Example 1. (A Shortest Path Example) 

Consider the graph G = (N, E) in Figure 1. 




Figure 1. 

Let E be the set of arcs. Construct £ so that Xe £ if X is the arc set of a directed tree rooted at node 1. Further 
restrict £ by requiring that any string containing an arc incident with node 4 is basic. 
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E = (a, b, c, d, e), and £ = {<{), a, b, ab, ac, ad, ba, be, abd, abe, acd, ace, bad, bae), B = (ad, be, abd, abe, acd, 
ace, bad, bae). Note that adb £ £ because ad an arc incident with node 4, thus A(ad) = 0. For each Y e B, let us 
define the determining structure of Y as the (1,4) directed path contained in Y. Thus. 



d*(ad)=(a,d) 


d*(acd)= (a,d) 


d*(be)= {b,e} 


d*(ace) = (a, c, e} 


d*(abd)= {a,d} 


d*(bad)= (a,d) 


d*(abe)= fb, e] 


d*(bae)= (b, e). 



Note that each element of E is contained in at least one determining structure. Also note that no determining 
structure is strictly included in another. Thus (d*(Y): Y e B } is indeed a clutter on E. Note also that several 
elements of z have the same determining structure, thus their objective function values are equal. Without 
knowledge of v, we cannot say what the determining structure of nonbasic strings are. For instance, the determining 
structure of the string ab is the longer of the arcs a and b. 

2.2 Greedy Minimizing Algorithm 

Let Xe C Define the greedy generator G as the function G(X) = argmin X€A(X > w(X*x). A greedy chain of 
access is a chain of access Xq = 0, X r X 2 , ..., X k such that X i+1 = X. * G(X.). The greedily accessed basic string will 

be denoted with a subscript "G". A greedy system has the property that for any nonnegative weight function v, 
w(Y <S) < w(Y) for all Y e B. 

Example 2. (The Greedy System) 

Recall our network example for Figure 1. Let the weight function v be given by the following table, 
x: a b c d e 

vfx): 2 4 5 4 1 



Let OUT(n) = {x e E: tail(x) = n) and EN(n) = {x e E: head(x) = n) for each n e N. The following algorithm is the 
greedy algorithm for this system 

initialize : 

X o = 0 

AfX^ = OUT(s) 

MXJ = 0 
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for each x e E, r(x) = v(x) 
i = 0 

While lx. n IN(t) I = 0 
x u , = argmin xsA(Xi) r(x) 

X. ,=X.-x. . 
w(X UI ) = MX) + r(x i+J ) 

MX.^j) = A(X) - {x i+I } - {x e E: no (tail(x), t) directed path exists in (N, E - X. +J ) u OUT(head(x UJ ))} 
i = / + 1 
endwhile 

The set of feasible strings z is the set of strings which this algorithm generates for all possible nonnegative length 
functions v. The following table gives the outcome of the algorithm for the network above. 




The example ends with X 3 = X Q = abe. • 

The reader should recognize this algorithm as Dijkstra’s shortest path algorithm. In fact, several of our greedy 
systems are recasts of well-known network optimization schemes, the hereditary family (E, Q being set of sample 
paths for the algorithm. While this representation is inefficient for the deterministic problem, it is vital for the 
extension to the case of random weights. 

3.0 CONSTANT ACCESS AND INTERVAL PROPERTIES 

We must further restrict our optimization scheme in order to guarantee memorylessness of the random weighted 
extension. Ideally, further restriction of the deterministic system should be independent of v except where it impacts 
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d*, and locally verifiable, having to do with the relationship of X to A(X). The following two properties meet this 
ideal and guarantee memory lessness to randomly weighted systems. 

3,1 Interval Property 

The following property, the interval property, is an extension of the interval property given by Korte’ and 
Lovasz [1984] in their description of a set of greedoids called alternative precedence structure (APS) greedoids. 

Let (E, 0 be a hereditary language. Let X, Y e £ such that X C Y. (E, Q has the interval property if for 
all Z e £ with X C Z C Y, we have 



[A(X)nA(Y)]CA(Z). 

Thus, during construction of a chain of access, if x e E becomes accessible at some stage, call it j(x). x remains 
accessible until either it is accessed or removed from the set of accessible elements. Once an element is removed 
from the set of accessible elements, it will never be accessible again. 

Example 3. 

Returning to the ongoing example, consider arc d. At the onset, d is not accessible. Consider the string abe e 
B. For this string, d is accessible once a has been accessed, thus j(d) = 1. d remains accessible during stages 2 and 
3. Once e is appended to ab, d is no longer accessible. This property can be verified for all elements of E for each 
member of B. 



-3.2 Constant Access Property 

The system (E, £, d*) has the constant access property if for each Xe (-B and each Y e B with X C 



Y, 



I A(X) n d*(Y) | = 1. 



Equivalently, (E, £, d*) has the constant access property if for all x e A (X), x = X n P for some P e T(X). In a 
subsequent investigation, we will generalize this property to allow | A(X) n d*(Y) | = n(X), where n(X) is a known 
constant depending only on X. 
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Example 4. 



In our ongoing example, note that for each X e £ - B, A(X) is contained in a (1, 4) cutset and consists of the 
arcs pointing toward node 4 (a uniformly directed cutset, UDC), resulting in | A(X) n P | = 1 for all sets P which 
are (1, 4) directed paths, (Sigal, et. al. [1980]). • 

Greedy systems which have the constant access and interval properties, are greedy systems, and have 
determining structures which form a clutter on the ground set are called constant access systems. 

3*3 Systems with the Constant Access Property 
Henceforth, (E, £, d*) will be assumed to be a constant access system. We will now present a set of results 
which give a formula for the cost of constructing the greedy chain of access. This formula is the key to the proof of 
memorylessness in the next section, as well as enhancing our understanding of deterministic greedy access systems. 

For any X e £, X = (x r x 2 , ..., x n ), let j(x.) = min{j: xj e A(Xp} for each i = 1,2, ..., n. Thus, j(x.) is the 
first stage for which Xj is accessible. 

Lemma 1. Let Ye B, Y = (y r y , ..., y ). Let i and k be such that i < k < m. Then y e d*(Y k ) implies that 

Proof. Consider the stage j(yi) - 1, the stage immediately preceding the stage when y becomes accessible. By the 
constant access property, there exists unique x e d*(Y k ) in the set A(Y^^_j). If yj e A(Y.^ p n d*(Y k ), then x e 
A(Yj(y p because only one member of d*(Y k ) may be in A(Y j>(y p. Thus x is in A(Y j>(y ^), x is not in A(Y j(y ) ), and x 

e d*(Y k ) hence x e Y k * The interval property guarantees that x = yj^. • 

Upon reflection, lemma 1 gives good insight into the workings of access systems with the constant access and 
interval properties. It states that once one member of the determining structure is identified, the members of the 
determining structure accessed before it are known automatically. In the next lemma, we establish that if an element 
X is generated greedily, the last element of X is a member of d(X). 

Lemma 2. Let (E, £, d*) be a constant access system. Let X be a greedily generated string, | X I = n. Then for 
each x e A(X), x e d*(X-x). 

Proof. See appendix A. 

Lemma 2 is based on some observations about the greedy generator. Consider the possibility that x e d*(X • 
x). In this case w(X) = w(X • x) and accessing x is "free." Two possibilities exist. Possibly x has been accessible 



8 



before stage m, in which case we would have accessed this low cost element before this stage. The other possibility 
is that x was not accessible before stage m. In this case, j(x) = m. This implies that x and x m are both members of 
some element K of T(X • x) and 

-x) V ( Z ) = v 00 + ^ V ( z ) 

so accessing x is certainly not costless. Hence we derive a contradiction in either case. 

Thus, the greedily generated elements X e C are closed in the sense that feasibly adding any element of E - X 
increases the objective function value of the string. 

Lemma 3. Let Xj e £ be generated by the greedy generator. Let z k = w(X k ) -wfX^ ,), k = 1, 2, .... i. For each z 
e A (X.), let C z = v(z) - [t j(z)+1 + x. (z)+2 + ... + x.]. Then 

w (Xj • z) - w(X.) = C z . (3.1) 

Proof. Consider z e A(X.). Let J € T(X. • z) such that 

^xeJn^ufz]) v ( x ) - ^-xerrOCj^z)) v ( x ) 

for all J' e r(Xj • z), thus J n (Xj u {z}) = d (Xj * z). By lemma 2, we know that z e J, and by the constant access 
property ( x j( z )+i + x j(z)+2 + — + x i) n d *CX * z) = 0. Thus w(Xj • z) = w(Xj( z p + v(z). Thus, the defmition of 
the t's gives us the result 

w (Xj • z) - w(Xj) = v(z) - [Tj( z )+i + Xj( z )+2 + + ^il- • (3.2) 

Corollary 4. G(Xj) = argmin zeA(Xi) C z . 

Proof. A result of lemma 3 and the defmition of the greedy algorithm. • 

Lemma 3 enables us to directly compare the incremental costs of the elements appendable at a given stage. In 
the sequel, we will consider the case where (v(x): x e E) is a set of independent, exponentially distributed random 
variables. We will use lemma 3 to show that at each stage, the costs C z are memoryless with respect to the 

elements already accessed, and thus the incremental costs of access remain independent and exponentially distributed. 

Example 5. 



Let us return again to our ongoing example, the weights of the arcs given by 



x: 


a 


b 


c 


d 


e 


v(x): 


2 


4 


1 


4 


1 
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Consider the string X = ac, which the greedily generated string of length 2. A(ac) = {d, e) , with j(d) = 1 and j(e) = 2. 
By lemma 2, d e d*(acd) and e e d(ace). By lemma 1 we identify d*(acd) as (d, x j(<J) , ...] = {d, a}, and d*(ace) = (e, 
x.. , ...} = (e, c, a) , both sets are arc sets of (1, 4) directed paths. By lemma 3, w(acd) - w(ac) = C = v(d) - 1 = v(d) 

j(c) d 2 

- [w(ac) - w(a)] = v(d) - [v(c) - 0] = 3. w(ace) - w(ac) = C c = v(e) -0=1. 

Y g = ace, as predicted by corollary 4. • 

4.0 STOCHASTIC CONSTANT ACCESS SYSTEMS 

We are primarily interested in models of system behavior in which the critical measure of performance is a sum 
of the weights of a determining structure of a basic element In the last section, we have developed characteristics of 
these types of optimization problems when the weight function is a known function v:E — » 9\ + . We now wish to 
consider situations in which { V(x) :x£ E} is a set of random weights of ground set elements, however, we wish to 
solve the minimum weight basic element problem using greedy minimization which implies definite knowledge of 
the incremental costs of adding various elements of the accessible set at each stage. We thus propose the following 
scenario: at the time that the optimization is to take place, the ground set weights (arc lengths in our examples) are 
known. However, prior to any realization of the problem being encountered, (V(x) : x e E) is a set of random 
weights for which we have distributional knowledge. Thus, from a strategic point of view, the constant access 
system being considered may be analyzed as a system with stochastic performance. Tactically, the system is seen 
as a deterministic greedy problem. 

Accordingly, we will now conside'r the case of optimization in the context of uncertainty. Let (V(x) : x e E) 
be a set of nonnegative random weights, and let (W(X) : X e Q be the associated set of stochastic determining 
structure objective function values. Thus, we wish to derive the joint distribution function F given by 

F(Y, t) = P[W(Y) < t, W(Y) < W(Y f ) for all Y f e B] 

for each Ye B. With F in hand, the derivation of 

p(Y) = lim t ^F(Y,t); 

F(t) = L ygB F(Y.t); 

which represent the probability a basic element Y is optimal and the distribution of the minimum weight basic 
element, resp., are direct We will also demonstrate some straightforward methods for deriving performance measure 
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distributions, expected values, and conditional expected values, all of which exploit the properties of the Markov 
process we develop. 



4.1 Sample Paths of the Greedy Minimizing Algorithm 
As mentioned in the introduction, we will model the execution of the greedy algorithm as a stochastic process, 
a novelty in the literature of stochastic combinatorial optimization. Let (X(t), t > 0) be a time homogeneous 
stochastic process on state space £ with transition epoches S 0 = 0, S,, S 2 , .... and intertransition times t. = S ; - S j . . 

(X(t), t > 0) has the following qualities: 

i) P[X(0) = 0] = 1; 

ii) P[X(t + s) = Y | X(s) = Y] = 1 for all Y e B, s,t > 0; 

iii) P[X(S n ) = X • x, x n = t | X(S n l ) = X] 

= P[W(X-x) - W(X) < W(X y) - W(X) for all y 6 A(X), W(X x) - W(X) = t]. 

Hence, (X(t), t > 0} starts in 0, and is absorbed in any element of B. Furthermore, the probability of making 
transition from X to X • x occurs after W (X • x) - W(X) time units, and then only if transition to X • y for some 
other y e A(X) hasn't already occurred. By virtue of i - iii, we may extend the definition of F to include nonbasic 
elements of £: 

F(X, t) = P[W(X) < W(X’) for all X e C. I X’ | > | X | , W(X) < tj. 

Thus, F(X, t) is the probability that X is on the (random) greedy sequence and that its objective function value is 
less than or equal to t Since the length of X increases at each stage, we may guarantee that the transition matrix of 
the underlying discrete process of X(t) is uppertriangular by assuming that the elements are listed in increasing 
length. 

Note that without any further distributional assumptions, (X(t), t > 0) is a generalized semi-Markov process 
(GSMP), and that imposition of the interval property on (E, Q restricts (X(t), t > 0) to the set of noninteruptive 
GSMPs, see Schassberger [1976]. However, results concerning GSMPs are almost exclusively concerned with 
steady state behavior of the system. Because the characteristics of (X(t), t > 0) we seek concern transient behavior, 
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GSMP theory is of little help in the current context. Research into characteristics of GSMPs with uppertriangular 
transition matrices may be motivated by the systems discussed in this paper. 



4.2 Exponentially Distributed Weights 



Let { V(x) : x e E} be a set of mutually independent, exponentially distributed random variables with rates (p(x) : x 
e E). Recall that j(y) = min {j: y e A(Y.)). 

Lemma 5. Let Ye £, | Y I = n. Let y e A(Y). Then 



Furthermore, given X(S.) = Y., x j(y)+1 , x^ )+2 , ... , the set of random variables 
{ V(y) - - x jCy)+2 - ^ : y g A(Y.)) is a set of mutually independent random variables. 

Proof. We induct on i. For i = 0, the proposition simplifies to the assumption of independent, exponentially 
distributed weights, j(x) = 0 for all x e A(0). 

Consider the lemma statement as an induction hypothesis true for 0, 1, ..., i. For every y e A(Y.), equation 
4.1 is true for j(y) + 1, ..., i. Note that the condition X(S.) = Y implies that for every y e A(Y), V(y) > x. (y)+1 - 

w-- T r Thus 

X. = min (V(y) - T j(y)+1 - x w+2 - ... - X n : y e A(Y .)) ~ min (V(y) : y e A(Y.)} 
is the minimum of a set of mutually independent, exponentially distributed random variables, which implies that x. +1 
- exp p(Y.), where 



By invoking the strong memoryless property, we have { V(y) - Xj (y)+1 - Xj^ )+2 “ — ~ z i~ T i+i : y G A(Y.) n 
A(Y i+ i)} is a set of independent, exponentially distributed random variables because A(Y.) is assumed to be a set of 

independent random variables. Since {y: j(y) = i + 1) are assumed to be independent of the history of {X(t)} to this 
point, we have established that (V(y) - x. (x)+1 -x (x)+2 - ... - x.- x. + i : y € A(Y. +1 )} is a set of independent, 

exponentially distributed random variables. • 

Let Q be an | £ | x | £ | matrix given by 




(4.1) 



409 = 1^.) M-(y). 



(4.2) 
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Qx,Y = < 



400 

-4W 

0 



Y = Xx e C 
X = Y 
otherwise. 



(4.3) 



Theorem 6. {X(t), t > 0) is a continuous time Markov chain with infinitesimal generator matrix Q. 

Proof Let Y € | Y | = k. By lemma 3, we know that, conditioned only on the greediness of Y, 

W(Y • y) - W(Y) = V(Y) - [x j(y) 4- x j(y) ^ + ... 4- xj 

for each y e A(Y). Thus, the implication of lemma 5 is that, conditioned on Y being greedy, the set (W(Y y) - 
W(Y): y e A(Y)} is a set of mutually independent, exponentially distributed random variables. 

Let P x Y (t) = P[X(t) = Y | X(0) = X] for each pair X, Y e £. 

Corollary 7. Let Ye B. Then F(Y, t) = P[X(t) = Y] = P 0Y (t) 

Proof. We designed {X(t) } such that sample paths of this process are greedy access chains. Since (E, d*) is 

assumed to be a greedy system, sample paths terminate in greedy optimal basic elements. • 

Thus, we have shown that F(Y, t) is a first passage time distribution of a Markov process with state space 
and generator matrix Q. 

Example 6. 

Reconsider the ongoing shortest path example. Suppose we wished to find F(abd, t). We can write the 
Kolmogorov equation P’(t) = P(t)Q as a set of first order differential equations which may be solved iteratively. In 
the case of abd, the system is given by 
P 0 ^ , (O = -IWa) + »i(b)] P 0i0 (t) 

P 0 ;(t) = 4 (b) P 0 0 (t) - [ 4 (a) + 4 (e)] P 0 fb (t) 

P 0 bl ’(t) = 4 (a)P 0 b (t) - [ 4 (d) + 4 (e)] P 0 ba (t) 

P 0. b .d’(O = ft(d)P 0 , bl (t). 

When the rates are given by: 

4(a) = 2; 4 (b) = 1; 4(c) = 4; 

4(d) = 1; 4(e) = 3 

this system has solution 

F(bad, t) = P 0> bjd (t) = P[W(bad) < W(Y) for all YeB, W(bad) < t] 
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= 1/30- 1/3 e 3t - 1/5 e 5l + 1/2 e' 4T • 

4.3 Performance Measures 

In this section, we discuss some of the uses of the distribution F(Y, 0 in characterizing some measures of 
performance of the stochastic constant access system. While the fundamental equations 

i) F(Pj, t) = P[W(Y) < t for some Y e B such that d*(Y) = P;] 

= ^y ;<j *(y) - P; FO\ 0 for each Pj e {d*(Y): Y e B } 

ii) F(t) = P[W(Y) < t for some Y € B] = I YeB F(Y, t) 

iii) P Y = P[W(Y) < W(Y’) for all Y' € B] = lim F(Y, t) 

are obviously valid, there exist more efficient methods for the computation of these distributions that do not require 

full knowledge of F(Y, t) or even generation of every element of Historically, studies cited in the introduction 

were focused on the calculation of F(t) for each example problem. Analysts undertaking analysis of some stochastic 

constant access system may have no need for the joint distribution. 

Let P = (P: P. = d*(Y) for some YeB). Let £ p = (£ - B) u P. Consider the modified continuous time 

P 

Markov chain (X p (t), t > 0} on state space £ p with transition probability matrix Q given by 
Q P x.y = Q x ,y X, Ye ^-B 

Q P x.Pi = Q x ,y YeB,d*(Y) = P.. 

Through this simple combining of basic elements of £, we have created a new process for which the absorption 
distribution is P[X p (t) = P. I X p (0) = <(>]= F(P., t). For the shortest path problem, F(P., t) is the probability that 
P. is the shortest path and it’s length is less than or equal to t. 

Arguably, the process (X p (t)} makes {X(t)} obsolete, as we are rarely interested in all of the sample path 
information {X(t) } can provide. More to the point, { X p (t) } seems to be very inefficient because it has several 

indistinguishable sample paths. The process (X p (t)} may be streamlined by performing the following procedure on 
P 

the matrix Q and state space £ p . We call this procedure the lumping procedure for determining structure 
absorption. 

initialize: 

L=P . 
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p p p p 

while there exist X.Ze £ p such that Q xw = Q Z.W = °f or al1 w e £ p - L and Q xw = Q z H - for 

all W e L 

P P P 

for every T € replace Q Tx with Q TX + Q rz 
remove Z from £ p 

p 

replace L with L u {X e £ p : Q x w = 0 for all We £ p - L} 
repeat. 

Note that performing the lumping procedure preserves the uppertriangularity of generator matrices. An 
analogous procedure may be constructed for any set of combined absorbing states, and the procedure extends to 
discrete time Markov chains in the obvious way. The theoretical importance of the lumping procedure is that it 
assures us that the system we choose to analyze has no redundant sample paths. In applications, we often use the 
lumping procedure in the abstract, lumping state space elements by some structural argument. In this case, the 
lumping procedure provides sufficient conditions for the validity of such an argument. 

The distribution of the weight of the optimal basic element may be derived via a method similar to the one just 
described. Suppose we combined all of the basic elements into a single element defining Cy = (C “ B) \j 
and (Xvp(t), t > 0) with generator Q defined by 

Q^x.y = Qx.y if Y e B 

Q X.Y “ B Qx,Y’ 

Then P[X T (t) = Y | X T (0) = <{)] = F(t) is the distribution of the weight of the minimum weight clutter element 
Example 7. 

By lumping the states with identical determining structures and performing the lumping procedure, we gready 
reduce the size of the state space. This reduces the sate space size from I £ I = 14 to | £ p ! = 8. If we are interested 
only in F(t), the distribution of the shortest path, we may further reduce the state space size to I Cy I = 5. On larger 

or denser networks, these reductions are more pronounced. 

We need not generate the original state space £ to generate ^ or For the shortest path problem, nonbasic 

states with identical acessible sets may be lumped to give £ p . The same is true of I C\j/ 1 . Thus, we may perform 

the lumping procedure in the abstract, avoiding the computational work entailed in generating 
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4.4 Performance Measures Based on the Embedded Markov Chain 
Let (Y n , n > 0}be the embedded discrete time Markov chain for (X(t)). Thus, {Y n } has state space £ and 
transition probability matrix P given by 

p x.x * = M-O) MX)]” 1 (4.4) 

for Xx e For the process { YJ, there is exactly one sample path from <{> to each member of B. Thus, for Y e 
B, | Y I = m, we have the solution 

P Y = P[Y g = Y] = n„, J, . ^ p(y,) ftKYw))” \ (4.5) 

Some measures easily derivable by summing different subsets of (P Y : Y e B) from { Y n } are 

i) P[d*(Y G ) = P.] for each P. e P 

ii) P[x € d*(Y 0 )] for some x e E 

iii) P[|Y G | = m], m = 1, 2, .... |e| 

iv) P[ | d*(Y) | =i],i= 1,2,..., |E|. 

The fust measure is the probability that a given determining structure is the minimum weight determining structure. 
For the shortest path example, this is the probability that a given path is shortest The second density gives the 
probability that a given element of E is a member of the optimal determining structure, this is the probability that a 
given arc is on the shortest path. The third density function gives the distribution of the length of the optimal 
element. This is the number of steps taken by the greedy algorithm in solving the given problem--the distribution 
of the execution time of the algorithm. Finally, the last density gives the probability that the optimal determining 
structure is of a given length. This density is especially interesting if |i(x) is the same for each x e E. Each of 
these measures may also be calculated efficiently by lumping absorbing states in the obvious way and performing 
the lumping procedure. 

For any Markov chain (Z n , n > 0) with transition probability matrix P with strictly uppertriangular transition 
probability matrix, we solve the system 

p 0 = i; 

P Y = ^X€(; P X P X,Y 

directly for the set {P y : Y is absorbing in { Z n } } . 

Example 8. 
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Returning to the ongoing shortest path example, we have the following table for the basic elements: 



Y € B 


P[Y = Y Cf 1 


Y e B 


P[Y = Y C ] 


ad 


0.1111 


ocd 


0.1111 


be 


0.2000 


ace 


0.3333 


abd 


0.0278 


bad 


0.0333 


abe 


0.0833 


bae 


0.1000 



and for the directed (s. 0 paths: 



path set Pi 


PfPi is the shortest path in G] 


(b,e) 


0.3833 


{a, d) 


0.2833 


(a. c.e) 


0.3333 



and criticality indices 



arc x 


Pfx is on the shortest path in G] 


a 


0.6166 


b 


0.3833 


c 


0.3333 


d 


0.2833 


e 


0.7166 



4.5 Expected Value Analysis 

All of the Markov process’s we have considered, regardless of any lumping performed, have uppertriangular 

generator matrices. We present here three simple formulae for the computation of the k ^ 1 moment of the conditional 

time until absorption of a Markov process with uppertriangular generator matrix. Let Q be the generator of the 

4 / p 

original process { X(t), t > 0), let Q and Q be the generators defined above. Let Y e B and P. e P. Let U x , 
U x | p ., and U x | Y be given by 

U x = inf(t X^(t) e 'P | X T (0) = X} for every XgC t 

U x | P . = inf{L- X p (t) = P. I Xp(0) = X,Um w „Xp(t) = P 1 } for every Xe C p 

U X | Y = inf [t: X(t) = Y | X(0) = X, lim t _„ X(t) = Y} for every Xe C 

k k k 

and define the moments T x (k), T x | p .(k), and x x | y (k) as EU X ,EU x |p. ,andEU x | y ,resp. We seek the quanuties 
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x^(k) = E[W(Y G ) k ] 

x,| Pi (k) = E[W(Y G ) k | d*(Y G ) = P.] 

x,| Y 00 = E[W(Y G ) k | Y g = Y], 

The first step equation for U x is given by 

Ux = [1 + ^ Q' F X 2 U z] mV 1 . (4-6) 

with U T = 0. Using moment generating functions, we derive 

= D^x^ - 1) + Q xz x z(W] t-Q xx) (4.1) 

for each Xe ^ and each k = 1,2, and with x T (k) = 0. Using x x (0) = 1 for all X e ^ as a boundary condition, 
we can directly compute {x x (k): X e from (t x (k - U : X e and Q^. In the case of k = 1, equation 4.7 



simplifies to the familiar first step expected value equations 

*x(l) = r-Q^wcf + P^xz^zO) (4-8) 

vj/ vp -1 

where P x<z = Q xz t“Q Xf x] is transition probability from X to Z for the process {X Y (t)) . 

With minor modifications to this methodology, we may find x x | p .(k) for each X e £ p . Let us define the set 
C p . = [Xe £ p : P[X p (t) = P i | X p (0) = X] >0), thus C p . is the subset of £ p which communicates with P-. 

Following 4.7, we find 

X X | P A W = [kX x |p.(k - 1) + ^ZeCpi Q xz T z|Pi(k)] t-Q xz) * (4-9) 

Xp.| p .(k) = 0. Note that, consistent with a fundamental property of Markov process, the expected sojourn time in 

state X is unaffected by the conditioning. The form of 4.7 can also be used to find the expected value x^ | y(k), 

-1 

T X | yOO = t^x I Y^ ” 1 ) + ^-2C Y Qxz X z | PjOO] [“Qx^cJ * (4«l0) 

As mentioned before, the original process (X(t), t > 0} has a unique sample path to each basic element Let I Y | = 
m, then for each i < m, 4.10 simplifies to 

-1 

^Yj ) Y^) = ^ Yj I — ^ t^xeACYp M^ x )] + T Y i+1 |Y(^“ !)• 



Thus 

%| Y® = ^.jn-J^ACYi) H<*)f ^ (4.11) 

Example 9. 
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Revisiting our ongoing shortest path example, we calculate i d (l) = 0.6833 and t 0 (2) = 0.6655. This gives us 
a shortest (s, t) path length variance of 0.1986. Note that E[v(a) + v(c) + v(e)] = 1.0833, E[v(a) + v(d)] = 1.500, and 
E[v(b) + v(e)] = 1.333. Thus, if we were to naively estimate the length of the shortest path by the minimum of the 
expected value of the sums of arc lengths, we would overestimate the length by 0.4, over one standard deviation. 

5.0 EXAMPLES FROM NETWORK OPTIMIZATION 

In this final section, we present examples of constant access systems arising in network optimization. These 
constant access systems may be classified into two groups, those which have determining structures which are paths 
or cutsets in the network at hand, and those which involve the bottleneck objective function. Several of these 
constant access systems have already appeared in the literature as separate results. The purpose of presenting them 
here is to highlight their interrelationship and to build the reader's intuition with familiar structures. The k-trigger 
network example in Section 5.1 and all of the bottleneck objective function examples are presented in the literature 
for the first time in this paper. We shall illustrate the concepts and procedures described in sections 2 through 4 
using these examples. 



5.1 Stochastic Path and Cutset Optimization 

In this section, we present some constant access systems in which the determining structures are paths or 
cutsets. The examples provided are the shortest path system (Kulkami [1987]), the PERT system (Kulkami and 
Adlakha[1986]), the maximum flow on directed planar networks (Kulkami [1987]) and a new system which we call 
the k-trigger network. 

Example 10. (Shortest Path Systems) 

We have used an instance of the shortest path problem to motivate theory we have presented thus far. In this 
section, we present this problem in its full generality. Markov processes were first used to analyze shortest paths in 
Markov networks in Kulkami [1987]. 

Let G = (N, E) be a directed graph. Let s and t be two prespecified nodes in N, and suppose that there exists a 
(u, t) directed path for each u e N. We will speak of a path as a set of directed arcs, the incident nodes being 
implicit. If x e E is given by the ordered pair (k, 1), then we say head(x) = 1 and tail(x) = k. Let IN(n) denote the set 
[x e E: head(x) = n) and OUT(n) denote the set {x e E: tail(x) = n) for each n e N. 
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Cast in the notation of constant access systems, Dijkstra’s algorithm for finding the shortest path in G is riven 
by the following algorithm. 

initialize: 

X o = 0 

A(X 0 ) = OUT(s) 

MXq) = 0 

for each x e E, r(x) = v(x) 
i = 0 

While jXi n IN(t) I = 0 

= argmin xeA (Xi ) r(x) 

^ i + 1 ~ ^ i x i+i 

w(X ut ) = w(X0 + rfx^,) 

A(X U1 ) = A(X;) - {x i+] } - {x £ E: no (tail(x), t) directed path exists in (N, E - X ul ) u OUT(head(x i+1 ))} 
imi + 1 
endwhile 

Let £ be the set of strings possibly generated by this algorithm for all nonnegative length functions. Thus, let X be 
a string of arcs, I X | = i and let n = head(xj). X e £ if and only if 

i) (N, X) is an s-rooted directed tree; 

ii) There exists at least one directed (n, t) path P such that none of the nodes implicit in P are incident with 
edges in X. 

iii) Properties i and ii hold for every prefix of X. 

From these properties, it is obvious that X 6 B if and only if head^) = t. The set { A(X): X e Q is the set of 
uniformly directed cutsets (UDCs) in G along with the empty set. 

The determining structure of each Y g B is the unique directed (s, t) path contained in (N, Y). For X e £ - B, 
d*(X) is identified by 

^d*(X) V W = max YerpO ^d*(X)nX V ( X )» 

d*(X) is the subset of maximum weight of an (s, t) path contained in X, where the maximization is performed over 
those (s, t) paths which are determining structures of basic elements for which X is a prefix. 
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The verification of the constant access property for (A, d*) is a result of Sigal et. al. [1980]. They state that 

the intersection of a (s, t) path with a UDC is always a single element set. From our knowledge of Dijkstra's 
algorithm, we know that an arc x becomes accessible as soon as an arc incident with tail(x) is accessed. It remains 
accessible until it is accessed, or until there remain no (head(x), t) paths which are not ’’crossed" by paths of accessed 
arcs. From this intuitive argument, we see that (A, d*) has the interval property. 

Because (A, d*) is a greedy constant access system, we may apply the results from Section 3 to find (F(Y, 

t), Y g B, t > 0} when G is a network with arcs with independent, exponentially distributed lengths. The shortest 
path system has the property that for each Y e B, (N, Y) contains a unique (s, t) path. If we were not interested in 
the actual order of access, we would lose nothing by lumping together strings with identical underlying sets--in fact, 
the lumping procedure would do this automatically. This reduction in the size of the state space is especially 
dramatic for dense graphs. If we were interested in only the length of the longest path, the lumping procedure would 
combine all states with the same accessible set. Thus, the state space could be replaced by the set of UDCs. 

We may use the method for shortest path problems to analyze maximum flows in undirected planar networks 
with independent, exponentially distributed arc capacities by utilizing the topological dual of the network. It is well 
known that the minimum capacity cutset in a planar network G is identified as the shortest path in the dual network 
G’, where the arc lengths in G’ are the capacities in G. 

Example 11. (Longest Path Systems) 

Let G = (N, E) be an acyclic directed network. Again let s and t be two prespecified nodes in N, and suppose 
that there exists a (u, t) path for each u e N.. If we add { v(x): x e A), a set of weights representing durations of the 
tasks represented by the arcs, the resulting network is called a PERT network. In such a network, tail(x) = head(y) 
implies that activity y must be completed before activity x can commence, y has precedence over x. The goal of 
analysis of PERT networks is the identification of the longest path in G and its length. The well-known forward 
sweep algorithm for finding the longest path in G is given by the following 

initialize: 

A(X 0 ) = OUT(s) 
w(Xq) - 0 

for each x e E, r(x) = v(x) 
i = 0 
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While IXi-E I *0 

x ul = argmin xeA(Xi ) r M 
MX ul ) = W(XJ + r(x„,) 

if lXi n IN( head(x ui ) ) / = indegree(head(x ltl )) then 
A(X i+J ) = A(X) u OUT(head(x UI )) 
else 

A(X U1 )=A(X L ) 
i = i + l 
endwhile 

Let £ be the set of strings possible generated by nonnegative length functions and let B be the set of basic elements 
of £. This structure is the well-known schedule greedoid, so-named by Korte' and Lovasz [1984]. The determining 
structure of Y e B, | Y | = m, is constructed as follows: 

i) y m e d*(Y); 

ii) for each y 6 d*(Y), identify [y^, y i2 , y ik : head(yij) = tail(y)}. Let i* = max J=1 ^{ij}, then y* e d*(Y). 
Thus, the last arc accessed which points into tail(y m ) is in d*(Y), the last arc accessed pointing into that arc is in 
d*(Y), and so on. This backward chain ends when an arc y with tail(y) = s is identified as a member of d*(Y), 
forming a (s, t) path. 

Let us verify that (A, d*) has the constant access property. Consider X e £ - B. A(X) is obviously a 

subset of an (s, t) UDC. Again using the result of Sigal et. al. [1980], .we know A(X) contains at most one arc 
from each (s, t) path. We need to show that this number is exactly one for (s, t) paths in T(X). 

Let Y e B and consider k < I Y | . Let i = max{j < k: yj e d*(Y)}, thus y i is the last element of d*(Y) 
accessed at stage k. Let ye d*(Y) with tail(y) = headCy^. Because { Y] = A, and by the definition of i, y e A(Y j). 
Thus, A(Y { ) contains exactly one element of d*(Y). 

The interval property on (A, Q is straightforward to show, the proof is provided by Korte’ and Lovasz [1984], 
who called all greedoids with the interval property "alternative precedence structures," or APS greedoids. The greedy 
algorithm performed on (A, £, d*) is the obvious forward sweep algorithm, see Lawler [1976]. 
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Example 12. (Maximum Flow on Planar Directed Graphs) 

Let G = (N, E) be a directed pianar graph and let nodes s and t be prespecified source and sink nodes. We 
assume that for each u e N, there is at least one (u, t) path in G. Let v:E->9t + be a function giving the capacity 
values for each of the arcs. 

Let {Cl, C2, ...» Ck) be the set of UDCs in G. The maximum (s, t) flow MF is given by 

MF = ^xeCi v(x) - 

The constant access system constructed must have the property that (d*(X), Xe Q = (Cp C 2 , C k ). The 
development of the greedy constant access scheme to find the maximum feasible flow in G, given by Itai and 
Shiloach [1979], depends on the existence of the topmost path TP(E') in the subgraph G’ = (N, E') for any subset E' 
C E such that an (s, t) path in G'. The algorithm is given as follows: 

initialize: 

X o =0 

MXo> = 0 

for each x e E, r(x) = v(x) 
i = 0 

While TP(E - Xj) * 0 

x i+ , = argminxeTP(E - X) v(x) 

W (X U! ) = MX,) + r(x UI ) 
for each x € TP(E -Xi) 
r(x) = r(x) - r(x, fl ) 
i = i + 1 
endwhile 

Let C be the set of strings which this algorithm might generate for all possible choices of nonnegative capacity 
functions v, and let B be the set of basic elements. Let Y n e B. There is no topmost path in G' = (N, E - Y n ), but 
y n e TP(E - Y n _j). Thus Y n must contain an (s, t) UDC, and this UDC must contain y n . Chaining backwards, we 
are able to identify the UDC d*(Y n ) by lemma 1. 

This algorithm, known as the path filling algorithm, is shown to produce the maximum flow w(Y c ) = MF in 
Itai and Shiloach. (A(X): X e Q is the set of topmost paths in G. The constant access property holds as a result 
I C ; n Pj | = 1 for each path Pj in the set [Pj , P 2 , ..., P m ] of (s, t) paths. 
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Let us verify the interval property for (E, 0. For each xeEwe know that once x e A(X x ), x is on the current 
topmost path, and will remain in the set of accessible arcs until either x is accessed or the topmost path no longer 
includes x. Let k be the smallest index such that x e A(X k ). This implies that X k contains at least one arc of every 
(s, t) path which involves x. In stage n, n>k, x cannot be on the topmost path of (N, E - X n ) because X k c X n . 
Thus, (E, 0 has the interval property. Recapping, the system (E, £, d*) has the interval and constant access 
properties, is a greedy system, and (d*(Y): Y e B) is a clutter on E. Hence (E, 0 d*) is a constant access system. 

Let us consider the case where the capacities on the arcs are a set of independent, exponentially distributed 
random variables. The full process on the state space £ will give us the absorption time distributions F(Y, t) = 
P[X(t) = Y] = P[Y g = Y, w(Y) < t], for each Y e B. By lumping the members of Y by their determining 
structures, we may find F(C X , t), the probability that Q is the minimum capacity UDC in G and its capacity is less 
than or equal to L This may be accomplished by lumping strings with the same accessible sets, reducing the state 
space size to the number of (s, t) paths. 

The probability that the capacity of a given arc constrains the maximum flow of the network, the criticality of 
the arc, is seen to depend on the flow value. If we wish to find the criticality of a set of arcs K, we suggest a 
lumping of the basic states into two sets. One set contains all basic states for which at least one member of K is a 
member of the determining structure, and is lumped into the single state 4^. The other set contains the complement 
of the first and is labeled 4 / 2 . The lumping procedure should then be executed on the remaining state space, as 
suggested in Section 4.3. 

If one were interested in reducing the capacity of the network to ^ or less by interdicting arcs in the set K, one 
would be interested in 1 - PEX^ = 'Ffl = P[K contains at least one critical arc and flow is greater than tj as a 
measure of the importance of the set K at the flow value t^ Similarly, we can construct the embedded Markov chain 
as given in Section 4.4 to give the probability that a string is a minimum weight string, the probability that a UDC 
is the minimum capacity UDC, and the probability that a set of arcs K contains critical arcs. 

Example 13. (K-trigger Networks) 

Consider a directed acyclic network G = (N, E) with arc length function v:E -> 9t + . In this problem 
formulation, it is intuitive to regard the arcs of E as activities as in PERT formulations. Suppose that each node n 
e N has a requirement constant kn so that activities emanating from n cannot commence until activities pointing 

into n have completed. Suppose we are given prespecified nodes s and t. Assume that indegree(s) = 0. We are 
interested in the time of completion of the k t ^ arc in IN(t) to complete. 
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For the PERT formulation, = indegree(n) for each n e N, no activity in OUT(n) can start until all activities 
in IN(n) are complete. Thus, the time when the last arc completes is the length of the longest path in G. If k n = 1 
for all n e N, the time of completion of the first arc in IN(t) is the length of the shortest path in G. Thus, This 
problem which we name the k-trigger network problem generalizes both shortest and longest path problems on 
directed graphs. 

The k-trigger network model is also useful in modelling the assembly of information products such as tracking 
information assembled by an air control system. Each of the activities represents some data collection task or some 
ambiguity resolution activity. Each activity must have several independent inputs which it uses to produce a 
coherent product or conduct some data collection requiring an initial solution. These activities may also represent 
the command task, giving permission for subsequent activities to begin. 

We may find the completion time of the activity in IN(t) by the following greedy algorithm 
initialize: 

x o = 0 

wtXo) = 0 

for all x g E, r(x) = v(x) 

A(X 0 ) = OUT(s) 
i = 0 

While lx u IN(t ) / < k t 
x i+ i = argmin x€A(Xi) r(x) 

%i+l = ' *,+; 

MX UI ) = w(X0 + r(x t+1 ) 
for all x £ AfX : ) 

ifx) = r(x) - r(x UI ) 

if lx i+J u lN(head(x)) / = then 

A(X i+I ) = A(XJ - IN(head(x)) u OUTfheadfxJ) -{xe E: no (tail(x), t) path exists in 
(N,E-X i+I ) uOUT(head(x i+I ))} 

else 

A(X UI ) = A(Xj) - {x l+l } -{xe E: no (tail(x), t) path exists in (N, E - X itI ) u 
OUT(head(x i+ ,))} 

/ = =i + 7 
endwhile 
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Let C be the set of strings generated over all length functions v and let B be the set of basic strings. Clearly, if 
this algorithm generates the basic string Y n , we know that y n is the k^ arc in IN(t) to complete, thus clearly y n e 
d*(Y n ). Furthermore, recall that j(y n ) is the minimum j such that y n e A(Yj). From the algorithm, we see that 
headty^yj) = tail(y n ), and y j(yn) is the k^^ arc to be accessed in IN(tail(y n )). Hence, it must be on the longest path 

from s to tail(y n ) in the subgraph (N, Y n ). Thus, we can chain backwards to identify d*(Y n ) as the longest (s, t) path 
in the subgraph (N, Y n ). The length of this path is the shortest completion time of the assembly process. 

Because d*(Y n ) is always an (s, t) path, we have that (d*(Y): Y e B) is a clutter on E. The interval property 
holds because an arc x becomes accessible when k^^) arcs in IN(tail(x)) have been accessed and remains accessible 
until it is accessed or until k hcad(x) arcs in IN(head(x)) are accessed. In the latter event, x remains inaccessible 
thereafter. 

The constant access property is more difficult to verify. One must recognize that given that ^ is generated by 
the above algorithm, A(X { ) is a partial UDC. One must show that any (s, t) path for which | ACX^ nPj =0 
is dominated in length by at least one path P 2 for which | A(X { ) n P 2 I =1. Pj will never be the longest (s, t) path 
in (N, Y) for any Y z> X i , Y e B. Hence, e r(X.). Thus, the constant access property holds for this system. 
The system has the three properties necessary for it to be a constant access system. 

We can determine the probability that a given arc is critical, a member of d*(Y G ), by using the embedded 
Markov chain. We can derive interesting performance measures such as the distribution of the total time of 
assembly, the probability that a given arc is critical given the assembly time is less than t^ and the probability that 
a set of arcs contains a critical arc given that the assembly time exceeds by using the lumping procedure to alter 
the matrix Q. 



5.2 Systems with Bottleneck Objective Functions 
In this section, we discuss three constant access systems which use the bottleneck objective function. The 
bottleneck objective function, first specified by Edmonds and Fulkerson [1970], is used to find the structure with the 
lowest cost where the cost of a structure is the weight of the maximum weight element in the structure. In this 
section, we present examples where the structures are cutsets, paths and trees. These are given in network reliability, 
bottleneck shortest path, and bottleneck minimum weight tree. 

Example 14. (Network Reliability) 

Consider a network G = (N, E) with undirected arcs whose usability is perishable. For instance, consider a 
communications network with links which fail with time. The network contains a set S of sender nodes and a 
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disjoint set T of terminals. We are interested in the time it takes for the network to fail to the point where there is 
no path of usable arcs from some member of S to some member of T, that is, the time that S and T are no longer 
completely connected. Note that this problem has (s, t) and (s, K) reliability as special cases. 

Let { Cj , C 2 , .... C k } = C be the set of (S, T) cutsets, and let v:E — » 9l + be a function giving the Iifelength of 
each arc. The quantity of interest is the time of failure TF of the longest lived arc in the shortest lived cutset, 

TF = minq € c max^c, v(x). 

TF is a well-known instance of the bottleneck objective function on the set C. The obvious algorithm for finding 
TF is given as 



initialize: 

X o = 0 

w(Xo) = 0 

for all x € E, r(x) = v(x) 

1 = 0 

While S and T arc completely connected in (N, E - Xf 
x l+l = argmin xeE _ x . r(x) 

= 4 x,+i 

w(X t .i) = w(XJ + r(x ul ) 
for all x e E - X t 

r{x) = r(x) - r{x^j) 
i=i + i 
endwhile 

At each stage, w(X x ) = v(x i ), thus if the algorithm terminates in n steps, xn is the longest lived arc in the 
shortest lived cutset, and w(X n ) = v(x n ) is the time of disconnection. Let £ be the set of strings generated by this 
algorithm over all nonnegative failure time functions. 

The system (E, £, d*) has determining structures which are singleton sets, d*(X) = {x i } . Thus (d*(Y): Ye B) 
= E, thus (d*^ i: Y e B} is a clutter on the set E. For each X i e £, 

T(X) = (d*(Y): X i CY)=E-V A(K^ 
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thus the constant access property is satisfied, I d*(Y n ) u A(X i ) I = I y n I = 1 for each Y n such that X i C Y n . The 
interval property holds because every arc is accessible until it is accessed or the algorithm terminates. Thus, (E, £, 
d*) is a constant access system. 

Clearly, the network reliability problem for the case where the lifelengths are independent exponentials is 
solvable using Markov processes. By appropriate lumping of basic elements, we may determine for each time of 
failure the probability that a given cutset is longest lived and the probability that a given arc is the arc which 
determines the lifelength of the system. The embedded Markov chain may be used to find these quantities without 
regard for failure time. 

Example 15. (Bottleneck Shortest Path) 

We now turn attention to a system which finds the minimum weight path where path weights are given by the 
longest arc in the path. Let {P p P 2 , ..., P n } = P be the set of (s, t) paths in G. The bottleneck (s, t) path problem 
may be stated as: find the (s, t) path with the shortest longest arc. That is, find Pi which minimizes 

BP = minp i€ p max x€P . v(x). 

The following greedy algorithm finds the minimizing path and the optimal value BP. 

initialize: 

X o =0 
w(X o ) = 0 

for all x € E, r(x) = v(x) 
i = 0 

While Xj does not contain an (s, t) path 
x UI = argmin zeE _ x . r(x) 

x i .,=xrx i+1 

MX i+t ) = MXf + r(x UI ) 
for all x e E - Xj 

r(x) = r(x)-r(x i + ] ) 
i = i + 7 
endwhile. 

BP is given by w(Y 0 ). Let £ be the set of all strings generated by this algorithm. As with the reliability 
problem, the interval property holds because each arc is accessible at each stage prior to termination. The 
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determining structure of each Y m e B is y n , and A(Xj) = E - X x for all nonbasic X r Hence the constant access 
property must hold. Obviously (d*(Y): Ye B)=E,a clutter on itself. 

Thus, (E, £, d*) is a constant access system. The methodology in sections 4.3 through 4.5 may be used to 
find the distribution of BP, the moments of BP, and the probability that a given arc is the arc determining BP. Note 
that the minimizing path is not unique, and every (s, t) path in (N, X) is equally qualified to be the minimum 
weight path. 

Example 16. (Bottleneck Spanning Tree) 

Let {Tj, T 2 , ..., T n ) be the set of arc sets of spanning trees in the undirected network G = (N, E). The 
bottleneck spanning tree problem, very similar to the bottleneck path problem, is to find the spanning tree with the 
shortest longest arc, 



BST = minj- G j max XG j. v(x). 

The greedy algorithm to solve the bottleneck spanning tree problem is identical to the bottleneck path problem, 
except that we terminate the algorithm when Xi contains a spanning tree. The determining structures are singleton 
arc sets, and the interval and constant access properties hold. Hence, the system (E, £, d*) is a constant access 
system. 



6.0 CONCLUSION 

In this work, we have constructed a new structural framework for randomly weighted network optimization 
called a constant access system. If a structure has the properties we have given here, we may find the joint 
distribution of the minimum weight basis element and its weight by calculating the absorption time distribution of a 
Markov process. We provide the construction of this Markov process, and demonstrate expansively how' we may 
exploit the structure of the Markov process to derive measures of stochastic performance for the general problem. 

We have established that the mechanism of transition in a Markov process is to greedily minimize the sojourn 
time in every state. This fortunate property allowed us to model the execution path of the greedy algorithm as the 
sample path in a Markov process. 
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APPENDIX A. 



In this appendix we present the proof to lemma 2. 

Lemma 2. Let (E, £, d*) be a greedy constant access system. Let X be a greedily generated string, | X | = n. 
Then for each x g A(X), x g d*(X*x). ~ 

Proof. For each i, define the following two subsets of T(Y • y). Let D = { J g T(Y • y) such that 

^zGJ nX'x V ( Z ) = maX JGr(X-x) ^zGJrvXx V ( Z ) 

Thus, d *(X • x) = J n X • x for any J g D. Let K = {J g T(X • x): x g J). Let = {J e r(X^) such that 

^zGJnX k V ( z ) ~ maX JG r(X k ) ^zGJnXfc V ( Z ) 

Thus, d^X^) = J n X^ for any J g D^. Let = {J g T(X ^): x g J) We will show that if K^. C for k = 0, 
1, ..., i, then K C D. This will prove the lemma by induction. 

jj( 

Let i = 0. In this case the proposition holds trivially since K = D = {d (Z): Ze B), Thus, suppose that fork 
= 0, 1, ..., i, Kfc C D^-. In order to show that this implies that K C D, we need to treat two cases: j(x) = i, and 

j(x) < i. 

Case 1 : j(x) = i, thus x is accessible only after xj has been accessed. Let KeK. Then lemma 1 gives us that Xj g 
K so K g Kp Thus, by induction hypothesis, K g Dj. We must show that K g D. 

Let J g D . Then 

Z zGJ rtX'x V ( Z ) S Zi€KrtC-» V (z)+V(x i+ 1) 

= S z€W* V ( Z >- (A- 1 ) 

Thus, K g D. 

Case 2 : j(x) = h < i. Let Kg K. Let J g D and assume that K £ D. Thus 

^zG KrOC * x V ( Z ) < ^zGJnX*x V ( Z )‘ 

The constant access property guarantees that Xj £ K, and the induction hypothesis guarantees that Xj g Jp 
Hence 

^zGKnXi., V(Z) + V(X)= V(Z) 

< ^GJnXi +I V (z) = S zGJnX w v(z) + V(Xi), (A.3) 
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the inequality resulting from equation A.2. Note that {xj, x] C A(Xj_j). It is straightforward to show that if 

inequality A. 3 holds, then G(Xj_j) * Xj. In fact, w(Xj_j • Xj) > w(Xj_j • x), and both Xj and x were accessible at 

stage i - 1. This shows that for case 2, if we assume KgK and Kg D, we can derive a contradiction. 

Thus, we have shown for both cases that K C D. The lemma follows directly. • 
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